Influence of facial views on the mcgurk effect in auditory noise
نویسندگان
چکیده
To investigate the nature of facial information involved in the integration of audiovisual speech perception, we examined the influence of facial views on the McGurk effect under two auditory conditions. While the speech perception of most of the audiovisual syllables used was little affected by the facial views and the auditory noise, a stronger McGurk effect was obtained for the 3/4-view image uttering labial sounds presented with auditory syllables of alveolars under the auditory noise. However, the facial view did not affect the visual identification of labials in the same way. These results suggest that the information about labial or nonlabial is not the only facial information involved in the McGurk effect. It appears some other information available only in the 3/4-view image might also be involved in the McGurk effect. Implications for the processing of visual, auditory and audiovisual speech are discussed.
منابع مشابه
The Mcgurk effect at various auditory signal-to-noise ratios in american and Finnish listeners
In the McGurk effect, incongruent visual information alters the auditory speech percept. We studied the strength of this effect as a function of auditory signal-to-noise ratio (SNR: -12, -6, 0, +6 dB, and noise-free) in Finnish adults, American adults and American children (8–12 years). The McGurk stimuli were A/p/V/k/ (auditory /apa/ presented with visual /aka/), A/p/V/t/, A/k/V/p/ and A/t/V/p...
متن کاملThe Influence of Quality of Information on the McGurk Effect
Quality of information in the McGurk effect was manipulated by using auditory stimuli that spanned a wide range of intelligibility, and by adding auditory and/or visual noise. Questions were whether responses are affected by subjects' awareness of the variation in stimulus quality, and whether quality of information affects type as well as number of McGurk responses. Expt 1 established the audi...
متن کاملFace configuration affects speech perception: Evidence from a McGurk mismatch negativity study
We perceive identity, expression and speech from faces. While perception of identity and expression depends crucially on the configuration of facial features it is less clear whether this holds for visual speech perception. Facial configuration is poorly perceived for upside-down faces as demonstrated by the Thatcher illusion in which the orientation of the eyes and mouth with respect to the fa...
متن کاملThe McGurk Effect Is Influenced By The Stimulus Set Size
This study examined if the size of the McGurk effect depends on the size of stimulus set presented in a block. The auditory syllables used in the present experiment was dubbed with either a compatible visible syllable or a discrepant visible syllable about place of articu-lation, resulting in 16 audiovisual stimuli. In the small set condition, two auditory consonants, {/pa/ and /ta/ } in one ca...
متن کاملAudiovisual sentence recognition not predicted by susceptibility to the McGurk effect.
In noisy situations, visual information plays a critical role in the success of speech communication: listeners are better able to understand speech when they can see the speaker. Visual influence on auditory speech perception is also observed in the McGurk effect, in which discrepant visual information alters listeners' auditory perception of a spoken syllable. When hearing /ba/ while seeing a...
متن کامل